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Abstract 

Previously proposed measures of entanglement, such as en- 
tanglement of formation and assistance, are shown to be special 
, cases of the relative entropy of entanglement. The difference be- 

| tween these measures for an ensemble of mixed states is shown to 

r~| ■ depend on the availability of classical information about partic- 

S^h. ular members of the ensemble. Based on this, relations between 

■£3 \ relative entropy of entanglement and mutual information are de- 

rived. 

In quantifying entanglement, a number of measures have been pro- 
posed. For bipartite pure states, pab, the Von Neumann entropy of the 
^ ■ reduced density matrix of either subsystem, pa or p B , has been found to 

be a good and unique measure, |J,@. Relative entropy of entanglement 
has been proposed as a measure which extends to mixed states, [||], ||. 
Loosely speaking, it quantifies how 'far' an entangled state is from the 
set of disentangled states. Entanglement of mixed states has also been 
characterised by the 'entanglement of formation', ||,[||, and by the 'en- 
tanglement of distillation', ||. Rather surprisingly, use of entanglement 
in mixed states is not reversible in the sense that all the entanglement 
required to construct a particular mixed state cannot be distilled out 
again, so the entanglement of formation is greater than the entangle- 
ment of distillation, ||]. In this paper, we clarify the role of classical 
information about the identity of particular members of an ensemble 
of mixed states, and show that the loss of such information is respon- 
sible for the difference between the entanglement of formation and the 
entanglement of distillation. We provide a unifying frame-work for en- 
tanglement measures by showing how previously proposed measures are 
special cases of the relative entropy of entanglement. This gives a strong 
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physical argument for using quantum relative entropy as a unique way 
to understand entanglement in general. 

Suppose that Alice and Bob share a state described by the density 
matrix pab- The state pab has an infinite number of different decompo- 
sitions e = {IV'ab) (V'abIjPiK i n ^° P ure states \ip l AB ), with probabilities 
Pi, [0]. We denote the mixed state pab written in decomposition e by 

Pab = S ^pMab)Wab\ (1) 

i 

The entanglement of formation is the average entanglement of the pure 
states, minimised over all decompositions, 0: 

E F (pA B )=mmy2p t S(p l B ) (2) 

i 

Here p l B is the reduced density matrix for subsystem A of the pure state 
\iPab) (V'abI- The physical importance of entanglement of formation lies 
in the fact that it is possible to convert an ensemble of m maximally 
entangled singlets into a smaller number, n, of non-maximally entangled 
states, using only local operations and classical communication, ||, 
and entanglement of formation is the asymptotic conversion ratio, — , in 
the limit of infinitely many copies. 

The 'entanglement of distillation', Ed(pab), is the number of maxi- 
mally entangled singlets per copy of pab which can be distilled from an 
asymptotically large ensemble of copies of pab by a purification proce- 
dure involving only local operations and classical communication, pL 
For a mixed state, it is lower than or equal to the entanglement of for- 
mation, j3|. 

Relative entropy of entanglement of the mixed state is defined as 
Ere(pab) = min S(p AB \ Wab) 

where S(p\\a) = Tr(p log p — p log ex) is the quantum relative entropy, 
The minimum is taken over D, the set of completely disentan- 
gled or 'separable' states. A state is separable if it can be written 
as a convex combination of product states a = J2iPi a A ® °b> with 
Y^iPi = 1- The relative entropy of entanglement provides an upper 
bound for the distillable entanglement, The known relationships 
between the different measures of entanglement for mixed states are 
therefore E d (pab) < E re (pab) < E f (pab)- Equality holds for pure 
states, where all the measures reduce to the Von Neumann entropy, 
S(pa) = S(pb)- We will give a straight-forward argument for the second 
inequality later in the paper. 
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Protocols for formation and distillation of pure and mixed entangled 
states have been introduced 0, @. We first briefly review the pure state 
procedures, and then go on to discuss the role of classical information 
and relative entropy of entanglement in the mixed state case. 

The basis of formation is that Alice and Bob would like to create 
an ensemble of n copies of the non-maximally entangled state, Pab, 
using only local operations, classical communication, and a number of 
maximally entangled pairs. It is customary to consider the process of 
formation which consumes the least entanglement, since the only 'cost' 
in communication is due to the use of entanglement resources, or sending 
information down a quantum channel, and classical communication costs 
nothing. Distillation is the reverse process, where Alice and Bob share 
an ensemble of n copies of the non-maximally entangled state, pab, and 
would like to extract the largest number of maximally entangled pairs 
using only local operations and classical communications. 

Formation of an ensemble of n non-maximally entangled pure states, 
Pab = (V'abI is achieved by the following protocol. Alice first 

prepares the states she would like to share with Bob locally. She then 
uses Schumacher compression, ||, to compress these states into nS(ps) 
states. One particle of each pair is then teleported to Bob using uS(pb) 
maximally entangled pairs. Bob decompresses the states he receives and 
so ends up sharing n copies of pab with Alice. The entanglement of 
formation is therefore E f (pab) = S(pb)- F° r pure states, this process 
requires no classical communication in the asymptotic limit, 0. The re- 
verse process of distillation is accomplished using the Schmidt projection 
method, which allows uS(pb) maximally entangled pairs to be dis- 
tilled in the limit as n becomes very large. Again, this process involves 
no classical communication between the separated parties. Therefore 
pure states are fully inter-convertible in the asymptotic limit. 

The situation for mixed states is more complex. When any mixed 
state, denoted by Eq. ([[]), is created, it is necessarily part of an extended 
system whose state is pure. We will consider the pure states \^ab) m 
the mixture to be correlated to orthogonal states \rrij) of a memory M. 
The extended system is in the pure state 



If we have no access to the memory system, we trace over it to obtain 
the mixed state in Eq.(|]). We will see that the amount of entanglement 
involved in the different entanglement manipulations of mixed states 
depends on the accessibility of the information in the memory at different 
stages. 
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Note that a unitary operation on \i^mab) will convert it into another 
pure state \4>mab) with the same entanglement, flCfl , 



\4>mab) = V^K")I Ab) ( 3 ) 
j 

Tracing over the memory in this case gives another decomposition, 
C = {\<P 3 ab) (0abI>?7'}) of Pab into pure states 

Pab = J2<lj Wab) {^ab\ ( 4 ) 
j 

The reduction of the pure state, (|3|), to the mixed state, (f|), may be 
regarded as due to a projection-valued measurement on the memory 
with operators {Ej = \rij) (rij\}. 

Consider first the protocol of formation by means of which Alice and 
Bob come to share an ensemble of n mixed state pab- Alice first cre- 
ates the mixed states locally by preparing a collection of n states in a 
particular decomposition, e = {\^ab) (^abIjPi} by making npi copies of 
each pure state \iP\b)- At the same time a memory system entangled to 
the pure states is generated, which keeps track of the identity of each 
member of the ensemble. Note that as long as we consider Alice's en- 
tire environment, the state of subsystems A and B together with the 
memory may always be taken to be pure. Later, we will consider the 
situation in which Alice's memory is decohered. There are then three 
ways for her to share these states with Bob. First of all, she may simply 
compress subsystem B to nS(ps) states, and teleport these to Bob using 
hS(pb) maximally entangled pairs. The choice of which subsystem to 
teleport is made so as to minimise the amount of entanglement required, 
so that S(pb) < S(pa)- The teleportation in this case would require no 
classical communication in the asymptotic limit, just as for pure states, 
||. The state of the whole system which is created by this process is 
an ensemble of pure states \i/jmab), where subsystems M and A are on 
Alice's side and subsystem B is on Bob's side. In terms of entanglement 
resources, however, this process is not the most efficient way for Alice 
to send the states to Bob. She may do it more efficiently by using the 
memory system of \iPmab) to identify blocks of npi members in each pure 
state \iPab), and applying compression to each block to give npiS(p B ) 
states. Then the total number of maximally entangled pairs required to 
teleport these states to Bob is n'^2 i PiS(p B ), which is clearly less than 
hS(pb), by concavity of the entropy. The amount of entanglement re- 
quired clearly depends on the decomposition of the mixed state pab- 
However, in order to decompress these states, Bob must also be able to 
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identify which members of the ensemble are in which state. Therefore 
Alice must also send him the memory system. She now has two options. 
She may either teleport the memory to Bob, which would use more en- 
tanglement resources. Or she may communicate the information in the 
memory classically, with no further use of entanglement. When Alice 
uses the minimum entanglement decomposition, e = {\ip\ B ) (^abI,^}, 
this process, originally introduced by Bennett et ai, ||, makes the most 
efficient use of entanglement, consuming only the entanglement of for- 
mation of the mixed state, Ef(pab) = ^iPiSiph)- We may think of the 
classical communication between Alice and Bob in one of two equivalent 
ways. Alice may either measure the memory locally to decohere it, and 
then send the result to Bob classically, or she may send the memory 
through a completely decohering quantum channel. In this case, the 
interaction with the channel is given by 

\^MAB) |c) = Y \fPi\ m i)WAB) \ c ) 
i 

¥ \/&Wab) K> \C%) 

i 

where |c) is the initial state of the channel and are orthogonal 

channel states. Since Alice and Bob have no access to the channel, the 
state of the whole system which is created by this process is the mixed 
state 

PABM = ^Pil^ABii^ABl ® \ m i)( m i\ ( 5 ) 
i 

where Bob is classically correlated to the AB subsystem. Bob is then 
able to decompress his states using the memory to identify members of 
the ensemble. 

Once the collection of n pairs is shared between Alice and Bob, it 
is converted into an ensemble of n mixed states pab by destroying ac- 
cess to the memory which contains the information about the state of 
any particular member of the ensemble. It is the loss of this informa- 
tion which is responsible for the fact that entanglement of distillation is 
lower than than entanglement of formation^. Distillation is not carried 
out by people like Alice and Bob who have access to the memory, but 
by people who have just received the ensemble of n mixed states pab 
with no further information. If Alice and Bob were to carry out the 
distillation, they could obtain as much entanglement from the ensemble 

1 The relation between classical information and distillable entanglement was pre- 
viously discussed by Eisert et ai, jnj, in a different context. 
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as was required to form it. In the case where Alice and Bob share an en- 
semble of the pure state \i[>mab), they would simply apply the Schmidt 
projection method, [![]. The relative entropy of entanglement gives the 
upper bound to distillable entanglement, 

Er E {\^{MA):b) (?P(MA):B\) = S{p B ) (6) 

which is the same as the amount of entanglement required to create 
the ensemble of pure states, as described above. Here MA and B are 
spatially separated subsystems on which joint operations may not be 
performed. In our notation, we use a colon to separate the local subsys- 
tems. 

On the other hand, if Alice used the least entanglement for producing 
an ensemble of the mixed state Pab-, together with classical communi- 
cation, the state of the whole system is an ensemble of the mixed state 
Pab mi an d the process is still reversible. Because of the classical correla- 
tion to the states IV'ab)) Alice and Bob may identify blocks of members 
in each pure state \iI>ab)i an d a Pply the Schmidt projection method to 
them, giving npiS(p B ) maximally entangled pairs, and hence a total 
entanglement of distillation of ^2 i PiS(p l B ). The relative entropy of en- 
tanglement again quantifies the amount of distillable entanglement from 
the state Pabm an d is given by 



Ere(Pa:(bm)) - min ^^(PabmIWabm) 

The disentangled state which minimises the relative entropy is 
® abm = YjiVi a% AB ® \ m i)( m i\, where a\ B is obtained from \i> % AB ){i> l AB \ 
by deleting the off-diagonal elements in the Schmidt basis. This is the 
minimum because the state Pmab is a mixture of the orthogonal states 
\rrii) \iPab)-> an d for a pure state |V'ab)j the disentangled state which min- 
imises the relative entropy is u\ B . The minimum relative entropy of the 
extended system is then 

s (Pabm\Wabm) = ^2piS(p l B ) 

i 

This relative entropy, Ere(p%(bm))i nas previously been called 'entan- 
glement of projection', [12|], because the measurement on the memory 
projects the pure state of the full system into a particular decomposition. 
The minimum of E RE (p A .^ BM ^) over all decompositions is equal to the en- 
tanglement of formation of Pab- However, Alice and Bob may choose to 
create the state pab by using a decomposition with higher entanglement 
than the entanglement of formation. The maximum of Ere(p%(bm)) 
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over all possible decompositions is called the 'entanglement of assistance' 
of Pab, j!3| - Because Ere(p a ., bm A is a relative entropy, it is invari- 
ant under local operations and non- increasing under general operations, 
properties which are conditions for a good measure of entanglement, ||. 
However, unlike Ere(pab) and Ef(pab), it is not zero for completely 
disentangled states. In this sense, the relative entropy of entanglement, 
Ere{Pa-(bm))i defines a class of entanglement measures interpolating 
between the entanglement of formation and entanglement of assistance. 
Note that an upper bound for the entanglement of assistance, Ea, can be 
shown using concavity, flSfl , to be Ea(pab) < m ^[S(pA), S(Pb)}- This 



bound can also be shown from the fact that the distillable entanglement 
from any decomposition, E RE (p A .^ BM A < Ea(pab) cannot be greater 
than the entanglement of the original pure state. 

We may also derive relative entropy measures that interpolate be- 
tween the relative entropy of entanglement and the entanglement of for- 
mation by considering non-orthogonal measurements on the memory. 
First of all, the fact that the entanglement of formation is in general 
greater than the upper bound for entanglement of distillation, emerges 
as a property of the relative entropy, namely that it cannot increase 
under the local operation of tracing one subsystem, 

E F (pab ) = min S (pabm 1 1 °abm ) > min S (p A B \ \ <?ab ) 

In general, the loss of the information in the memory may be regarded 
as a result of an imperfect classical channel. This is equivalent to Al- 
ice making a non-orthogonal measurement on the memory, and sending 
the result to Bob. In the most general case, {Ei = A^A^} is a POVM 
performed on the memory. The decomposition corresponding to this 
measurement is composed of mixed states, £ = {qi, Tr M (Aip M ABAf)}, 
where qi = Tr(AipMAB^f). The relative entropy of entanglement of 
the state P m abi when £ is a decomposition of pab resulting from a non- 
orthogonal measurement on M, defines a class of entanglement measures 
interpolating between the relative entropy of entanglement and the en- 
tanglement of formation of the state Pab- I n the extreme case where the 
measurement gives no information about the state pab, Ere{.Pa-{bm)) 
becomes the relative entropy of entanglement of the state pab itself. In 
between, the measurement gives partial information. We note that in- 
stead of an imperfect measurement, we may regard the memory itself 
as imperfect, in the sense that the memory states are non-orthogonal, 
(rrii \rrij) ^ for i ^ j. 

Now we will relate the loss of entanglement to the loss of information 
in the memory. As we have argued so far, there are two stages at which 
distillable entanglement is lost. The first is in the conversion of the pure 
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state \iPmab) into a mixed state Pabm- This happens because Alice uses 
a classical channel to communicate the memory to Bob. The second 
is due to the loss of the memory, M, taking the state pabm to pab- 
The amount of information lost may be quantified by the difference in 
mutual information between the respective states. Mutual information 
is a measure of correlations between the memory M and the system AB, 
giving the amount of information about AB which may be obtained from 
a measurement on M. The quantum mutual information between M and 
AB is defined as 

Iq{Pm-.{ab)) = S(p M ) + S(pab) - S(pmab) 

The quantum mutual information of the pure state \4>mab) is 
Iq{\^M:(ab)) (i>M-.(AB)\) = 2S(pab), and of the mixed state in Eq.(§) 
is Iq(pm-.(ab)) = S(pab)- Therefore the mutual information loss in 
the first stage is AIq = S(pab)- There is a corresponding reduction 
in the relative entropy of entanglement, from the entanglement of the 
original pure state, Ere(\iP(ma):b) {^{ma):b\), to the entanglement of 
the mixed state Ere{Pa-ibm)) ^ or a ^ decompositions e arising as the 
result of an orthogonal measurement on the memory. We now show 
that when the mutual information loss is added to the relative entropy 
of entanglement of the mixed state E RE (p A .^ BM ^), the result is greater 
than the relative entropy of entanglement of the original pure state, 
Ere{\ 1 I ) {ma):b) {^(ma):b\)- We show the result for the strongest case, 
which occurs when E RE (p £ A . (BM) ) = E F {p AB ): 

Er E {\iP(ma):b) (iP(ma)-.b\) < E f (pab) + S(pab) (7) 

The proof goes as follows. Let e = {\?Pab) (V'abIjP*} ^ e ^ ne m i n i ma l en- 
tanglement decomposition giving rise to the entanglement of formation, 
see Eq.(|). Then, 

S{pab) = ^2piS(\ip AB ) (tPabIWpab) 

i 

>Y^PiSM\p B ) 

i 

= S( Pb )-J2p*S(Pb) 

i 

The inequality results from the fact that the relative entropy does not 
increase under the local operation of tracing subsystem A, flQ|| . Using 



Eq.(y), and the fact that for this decomposition, Ef(pab) = YliPi^(P B ) 
gives inequality (0). 
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A similar result may be proved for the second loss, due to loss of the 
memory. After this, the mutual information between the memory and 
AB of the state pab is zero. Therefore the mutual information lost in los- 
ing the memory is again AIq = S(pab)- The relative entropy of entan- 
glement is reduced from Ere(p%(bm))i ^ or an y decomposition e resulting 
from an orthogonal measurement on the memory, to Ere(pab), the rel- 
ative entropy of entanglement of the state pab with no memory. We 
show that when the mutual information loss is added to Ere(pab), the 
result is greater than E RE (p A .( BM A. In this case, the result is strongest 
for E RE (p% (BM) ) = Ea(pab)- 

Ea(pab) < E RE ( P ab) + S(p AB ) (8) 

Let C = {Wab) (0abI)9«} be the maximal entanglement decomposition 
giving rise to the entanglement of assistance. Then 

Ere(pab) + S(pab) - Ere(p A: (bm)) = 
- min Tr (p A s In (Jab) - V'^S'(p^) = 

I 

YV(- min (4> AB \lna A B \<j> AB ) ~ S{.Pb)) > 
i 

J>( min S(\4>\ B ) (<f> AB \\\a\ B ) - S(p B )) = 

i -AB^D 

The inequality holds because oab is the disentangled state which min- 
imises the relative entropy of the state Pab-, but may not minimise the 
relative entropy for each of the component pure states, \4> A b)- Notice 
that if pab is a pure state, then S(pab) = 0, and equality holds. 

Inequalities (0) and (||) provide lower bounds for Ee(pab) and 
Ere(pab) respectively. They are of a form typical of irreversible pro- 
cesses in that restoring the information in M is not sufficient to restore 
the original correlations between M and AB. In particular, they express 
that the loss of entanglement between Alice and Bob at each stage must 
be accompanied by an even greater reduction in mutual information be- 
tween the memory and subsystems AB. This raises the interesting open 
question of whether the inequalities ([?[) and (||) may be generalised to a 
relation of the kind 

Ere(PA:(BM)) < Er E (XA:(BM)) + Iq(PM:(AB)) ~ Iq(XM:(AB)) (9) 

for any two entangled states, p and x> where % is obtained from p by 
any operation on the memory. This would give the physically reasonable 
property that loss of the information in M about AB is always greater 
than the loss of entanglement between the separated subsystems. 
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In summary, there are numerous decompositions of any bipartite 
mixed state into a set of states pi with probability pj. The average entan- 
glement of states in each decomposition is given by the relative entropy 
of entanglement of the system extended by a memory whose orthogo- 
nal states are classically correlated to the states of the decomposition. 
This correlation records which state pi any member of an ensemble of 
mixed states p®g is in. It is available to parties involved in formation 
of the mixed state, but is not accessible to parties carrying out distilla- 
tion. When the classical information is fully available, different decom- 
positions give rise to different amounts of distillable entanglement, the 
highest being entanglement of assistance and the lowest, entanglement of 
formation. When access to the classical record is reduced, the amount of 
distillable entanglement is reduced. In the limit where no information is 
available, the distillable entanglement is given by the relative entropy of 
entanglement of the state pab itself, without the extension of the clas- 
sical memory. Our work shows that relative entropy of entanglement 
provides a unifying measure for all cases, elucidating the role of classi- 
cal information and the appearance of irreversibility in manipulations of 
mixed state entanglement. 
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